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CM Development 



Accept CM Package 


1 .Identify ineffective CM(s) 

2. Change and continue testing 



Definition of Performance Criteria 

What are “acceptable” values 
for outcome markers? 

•Per subject-mission (“Level 1”) 
•Programmatic (“Level 2”) 
•Testability 
•Operationally driven 


Example: Bone Mineral Density (BMD) 
Level 1 performance criteria for a bone region: 

Outcome Marker: Bone Density 
Performance Criteria: 

•Success: Gain, or no loss relative to baseline. 

•Failure: Severe loss (3% or more from baseline). 
•Indeterminate: Small loss (less than 3% from baseline). 



% change in bone density: -3 -2-10 12 3 4 


Quantitative Countermeasure Assessment Example 
Level 2 performance criteria for a bone region: 


Satisfactory performance : 

Success (no bone loss) occurs on at least 90% of cases (astronaut- 
missions) 

and 

Failure (severe bone loss) occurs on no more than 5% of cases 
(astronaut-missions). 


Unsatisfactory performance 

Less than a 90% success rate or more than a 5% failure rate. 


Quantitative Countermeasure Assessment (overview) 



ITRrGenerate 
Outcome Markers 


Definition of 
Performance 
Criteria for 
Physiological 
Systems 



•Operationally 

driven 

•Testability 

•Per subject-mission 

•Programmatic 


•Long missions 
•Short missions 
•Analog studies 

Decision Process 
(sequential) 


•Statistical properties of 
outcome markers 

•Compliance assessment 

•Meta analysis 

•Uncertainty estimation 

•Identification 


•Satisfactory performance - 
Accept current CM’s protecting 
given physiological system 

•Unsatisfactory performance - 
Identify ineffective CM’s, then 
continue testing with remedies 

•No decision - collect more data 


Decision Process (no uncertainty) 

Programmatic Specifications : 

Success (no bone loss) on at least 90% of astronaut-missions 
Failure (severe bone loss) on at most 5% of astronaut-missions 

Actual Programmatic Parameters X and Y : 

No bone loss on X% of astronaut-missions 
Severe bone loss on Y% of astronaut-missions 

Decision: (if X and Y assumed known) 

X > 90 and Y < 5 : Countermeasure package OK for bone. 

X < 90 or Y > 5 : Bone CM not effective enough, take corrective 
action. 
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Sources of Uncertainty in the Decision Process 

(Quantitative Countermeasure Assessment) 

•Differences between individuals (sample size) 
•Differences within individuals through time 
•Variable degrees of countermeasure compliance 
•Differences between missions 
•Non-repeatability of ITR (procedural) 

•Variation in time of application of ITR 
•Direct measurement errors (output of ITR) 


Long-Duration Crew Members Available for All 
Flight Research, Including CM Validation 
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Assumptions: 

Full international 
participation 
2000 - 2003 

3 crew members/increment 
3-5 month missions 
2003 -2010 

6 crew members/increment 
6 month missions 
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Decision Process (with uncertainty) 

Programmatic Specifications : 

Success (no bone loss) on at least 90% of astronaut-missions 
Failure (severe bone loss) on at most 5% of astronaut-missions 


Interval Estimates of Performance Parameters : 

Gain or no bone loss occurs in (XI, X2) percent of cases 
(XI, X2) = 90% confidence limits 
Severe bone loss (> 3% ) occurs in (Yl, Y2) percent of cases 
(Yl, Y2) = 90% confidence limits 
Decision: 

XI > 90 and Y2 < 5: Countermeasure package OK for bone. 

X2 < 90 or Yl >5: Bone CM not effective enough, take 
corrective action. 

— I Otherwise: Continue to use bone CM, collect more data 
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Decision Process (cont.) 


% Severe loss o /o No loss 





Width of confidence intervals depends on sample size and 
statistical properties of ITR measurements 
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Sequential decision process 

Repeated confidence intervals for the system success rate 



Sequential decision process 

Repeated confidence intervals for the system failure rate 



Quantitative Countermeasure Assessment (overview) 


Definition of 
Performance 
Criteria for 
Physiological 
Systems 

•Operationally 

driven 

•Testability 

•Per subject-mission 

•Programmatic 


ITR: Generate 
Outcome Markers 

•Long missions 
•Short missions 
•Analog studies 


Decision Process 

(sequential) 

•Satisfactory performance - 
Accept current CM’s protecting 
given physiological system 

•Unsatisfactory performance - 
Identify ineffective CM’s, then 
continue testing with remedies 

•No decision - collect more data 


Data Analysis 

•Statistical properties of 
outcome markers 

•Compliance assessment 

•Meta analysis 

•Uncertainty estimation 

•Identification 
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